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Multi-criteria  decision  analysis  (MCDA)  methods  have  become  increasingly  popular  in  decision-making 
for  sustainable  energy  because  of  the  multi-dimensionality  of  the  sustainability  goal  and  the  complexity 
of  socio-economic  and  biophysical  systems.  This  article  reviewed  the  corresponding  methods  in 
different  stages  of  multi-criteria  decision-making  for  sustainable  energy,  i.e.,  criteria  selection,  criteria 
weighting,  evaluation,  and  final  aggregation.  The  criteria  of  energy  supply  systems  are  summarized  from 
technical,  economic,  environmental  and  social  aspects.  The  weighting  methods  of  criteria  are  classified 
into  three  categories:  subjective  weighting,  objective  weighting  and  combination  weighting  methods. 
Several  methods  based  on  weighted  sum,  priority  setting,  outranking,  fuzzy  set  methodology  and  their 
combinations  are  employed  for  energy  decision-making.  It  is  observed  that  the  investment  cost  locates 
the  first  place  in  all  evaluation  criteria  and  C02  emission  follows  closely  because  of  more  focuses  on 
environment  protection,  equal  criteria  weights  are  still  the  most  popular  weighting  method,  analytical 
hierarchy  process  is  the  most  popular  comprehensive  MCDA  method,  and  the  aggregation  methods  are 
helpful  to  get  the  rational  result  in  sustainable  energy  decision-making. 
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1.  Introduction 

Energy  including  renewable  energy  and  geologic  storages  is  an 
essential  input  to  all  forms  of  economic  and  social  activities  as 
shown  in  Fig.  1.  Energy  system  plays  an  important  role  in  the 
economic  and  social  development  of  a  country  and  the  living 
quality  of  people  [1,2].  The  major  energy  demand  of  fossil  fuels  has 
major  consequences  around  the  world.  A  main  environmental 
problem  is  the  emission  of  toxic  chemical  pollutants,  greenhouse 
gases  like  C02  and  other  air  pollutants  [3,4].  These  cause  climate 
change  and  environmental  pollution  of  air,  land  and  water,  which 
has  a  negative  impact  on  the  health  and  the  living  quality  of 
humans  [5].  Contrarily,  global  environmental  issues  could 
significantly  affect  patterns  of  energy  use  around  the  world  [6]. 
Some  new  governmental  policies  have  been  adopted  to  encourage 
the  introduction  of  energy  efficiency  measures,  the  technical 
changes,  and  the  renewable  and  sustainable  energy  [3,7,8]. 


The  sustainable  development  has  been  the  subject  of  wide- 
ranging  discussion  and  debate  within  government,  non-govern¬ 
ment  and  academic  circles,  being  a  major  focus  of  national  and 
international  economic,  social  and  environmental  agendas  [3,4,6- 
18].  Sustainable  development  means  the  satisfaction  of  present 
needs  without  compromising  the  ability  of  future  generations  to 
meet  their  own  needs  [19].  Sustainability  can  be  seen  as  the  final 
goal:  a  balance  of  social  and  economic  activities  and  the 
environment  [9].  A  sustainable  energy  sector  has  a  balance  of 
energy  production  and  consumption  and  has  no,  or  minimal, 
negative  impact  on  the  environment  (within  the  environmental 
tolerance  limits),  but  gives  the  opportunity  for  a  country  to  employ 
its  social  and  economic  activities. 

The  rational  decision-making  (DM)  in  energy  supply  system 
options,  planning,  management  and  economy  is  helpful  to  the 
sustainable  development.  However,  the  complex  interactions 
shown  in  Fig.  1  make  DM  more  difficult.  Sustainable  energy 


Fig.  1.  The  complex  interactions  of  energy  system. 
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decision-making  using  multi-criteria  decision  analysis  (MCDA) 
just  provides  a  method  to  eliminate  the  difficulty  and  it  has 
attracted  the  attention  of  decision  makers  for  a  long  time.  MCDA  is 
a  form  of  integrated  sustainability  evaluation.  It  is  an  operational 
evaluation  and  decision  support  approach  that  is  suitable  for 
addressing  complex  problems  featuring  high  uncertainty,  con¬ 
flicting  objectives,  different  forms  of  data  and  information,  multi 
interests  and  perspectives,  and  the  accounting  for  complex  and 
evolving  biophysical  and  socio-economic  systems.  The  methods 
can  provide  solutions  to  increase  complex  energy  management 
problems.  Traditional  single  criteria  approach  is  normally  aimed  at 
identifying  the  most  efficient  options  at  a  low  cost.  Growing 
environmental  awareness  in  the  1980s  has  slightly  modified  the 
single  criteria  decision  framework.  Nowadays,  the  focus  on  global 
environmental  protection  drives  MCDA  aid  in  energy  systems.  The 
MCDA  methods  have  been  widely  applied  to  social,  economic, 
agricultural,  industrial,  ecological  and  biological  systems  in 
addition  to  energy  systems  [20-27].  Compared  to  single  criteria 


approach,  the  distinctive  advantage  of  MCDA  methods  is  to  employ 
multi-criteria  or  attributes  to  obtain  an  integrated  DM  result. 

Generally,  the  MCDA  problem  for  sustainable  energy  DM 
involves  m  alternatives  evaluated  on  n  criteria.  The  grouped 
decision  matrix  can  be  expressed  as  follows: 
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where  Xy  is  the  performance  of  j-th  criteria  of  i-th  alternative,  Wj  is 
the  weight  of  criteria  j,  n  is  the  number  of  criteria  and  on  is  the 


Fig.  2.  MCDA  process  in  sustainable  energy  decision-making. 
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number  of  alternatives  (these  nomenclatures  are  just  the  same  in 
this  article). 

It  can  be  found  that  the  DM  problem  involves  alternatives, 
criteria,  criteria  weights  and  the  evaluating  result  from  Eq.  (1 ).  The 
corresponding  DM  process  can  be  formed  to  Fig.  2  [28,29].  It 
usually  includes  four  main  stages:  alternatives’  formulation  and 
criteria  selection,  criteria  weighting,  evaluation,  and  final  treat¬ 
ment  and  aggregation.  The  preliminary  step  in  MCDA  is  to 
formulate  the  alternatives  for  sustainable  energy  DM  problem 
from  a  set  of  selected  criteria  and  to  normalize  the  original  data  of 
criteria.  Secondly,  criteria  weights  are  determined  to  show  the 
relative  importance  of  criteria  in  MCDA.  Then,  the  acceptable 
alternatives  are  ranked  by  MCDA  methods  with  criteria  weights. 
Finally,  the  alternatives’  ranking  is  ordered.  If  all  alternatives’ 
ranking  orders  in  different  MCDA  methods  are  just  the  same,  the 
DM  process  is  ended.  Otherwise,  the  ranking  results  are  aggregated 
again  and  the  best  scheme  is  selected.  The  four  main  sections  in 
MCDA  are  presented  and  reviewed  in  Sections  2-5  respectively. 

2.  Criteria  selection 

2.2.  Literature  review  on  criteria  in  energy  DM 

The  energy  issues  applying  MCDA  includes  energy  planning  and 
selection  [11-13,30-47],  energy  resource  allocation  [48-54], 
energy  exploitation  [55,56],  energy  policy  [57-59],  building  energy 
management  [60-67],  transportation  energy  systems  [68,69]  and 
others  [70-75].  The  reviewed  literatures  covered  are  both 
theoretical/conceptual  and  empirical.  This  article  mainly  reviews 
the  MCDA  methods  for  the  selection  of  the  energy  supply  systems. 
The  reviewed  articles  have  different  energy  supply  systems,  such 
as  combined  heating  and  power  (CHP)  or  combined  cooling 
heating  and  power  (CCHP)  systems  [29,76-78],  renewable  energy 
systems  [35,39],  and  different  focus  such  as  technological, 
economic  and  sustainability  evaluation,  objective  and  subjective 


comparison,  the  impact  on  the  living  standard  and  the  sensitivity 
analysis  of  power  plants,  etc.  [43,79-81]. 

Measuring  sustainability  of  the  energy  supply  systems  is  a 
major  issue  as  well  as  a  driving  force  of  the  discussion  on 
sustainability  development.  Developing  evaluation  criteria  and 
methods  that  reliably  measure  sustainability  is  a  prerequisite  for 
selecting  the  best  alternative,  identifying  non-sustainable  energy 
supply  system,  informing  design-makers  of  the  integrated 
performances  of  the  alternatives  and  monitoring  impacts  on  the 
social  environment.  The  multiplicity  of  criteria  and  measuring 
tools  being  developed  in  this  fast-growing  field  shows  the 
importance  of  the  conceptual  and  methodological  work  in  this 
area.  The  development  and  selection  of  criteria  require  parameters 
related  to  the  reliability,  appropriateness,  practicality  and  limita¬ 
tions  of  measurement.  The  used  criteria  to  evaluate  the  energy 
supply  systems  in  the  literatures  mainly  divide  to  four  aspects: 
technical,  economic,  environmental  and  social  criteria,  which  are 
summarized  in  Table  1. 

2.2.2.  Technical  criteria 

2AAA.  Efficiency.  Efficiency  refers  to  how  much  useful  energy  we 
can  get  from  an  energy  source.  The  efficiency  coefficient  is  the  ratio 
of  the  output  energy  to  the  input  energy,  which  is  used  to  evaluate 
energy  systems.  Energy  efficiency  is  said  to  be  one  of  the  “twin 
pillars”  of  a  sustainable  energy  policy  [93].  It  has  been  proved  that 
efficiency  improvement  that  is  consistent  with  high  plant 
reliability  and  low-cost  of  products  is  economically  beneficial 
[94].  Efficient  energy  use  is  essential  to  slowing  the  energy  demand 
growth.  It  is  the  most  used  technical  criteria  to  evaluate  energy 
systems  [11,13,30,35-44,77,87]. 

2. 2. 2.2.  Exergy  efficiency.  Exergy  efficiency  (also  known  as  the 
second-law  efficiency  or  rational  efficiency)  computes  the 
efficiency  of  a  process  taking  the  second  law  of  thermodynamics 


Table  1 

The  typical  evaluation  criteria  of  energy  supply  systems. 
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into  account.  Energy  changes  from  one  form  to  another  during  a 
process.  In  contrast,  exergy  accounts  for  the  irreversibility  of  a 
process  due  to  increases  in  entropy.  Exergy  is  always  destroyed 
when  a  process  involves  a  temperature  change.  Exergy  is  the 
energy  that  is  available  to  be  used.  Exergy  analysis  is  performed  in 
the  field  of  industrial  ecology  to  use  energy  more  efficiently,  which 
was  first  coined  by  Rant  in  1956  [95].  The  CHP  (CCHP)  systems  in 
the  literatures  were  evaluated  in  these  criteria  [29,44,76]. 

2. 1.1.3.  Primary  energy  ratio  (PER).  PER  is  defined  as  the  ratio  of 
consumption  primary  energy  to  the  users’  demand  energy. 
Similarly  primary  energy  saving  is  also  a  criteria  that  provides 
an  estimation  of  the  amount  of  primary  energy  that  a  given  action 
allows  to  save.  Primary  energy  saving  can  be  assessed  as  the  annual 
saved  energy,  which  derives  from  fossil  fuels.  Such  a  saving  can  be 
estimated  by  means  of:  (1)  technologies  of  conversion  which  use 
renewable  energy  sources  or  (2)  reduction  of  final  energy 
consumptions,  under  the  same  operating  conditions.  PER  was 
employed  to  evaluate  CCHP  systems  in  [29,45,76]  and  primary 
energy  saving  was  adopted  to  show  the  performances  of  renewable 
energy  technologies  [82]  directly.  Also,  savings  of  finite  energy 
sources  were  used  [84]. 

2.1. 1.4.  Safety.  Continuous  changes  in  technology,  environmental 
regulation  and  public  safety  concerns  make  the  analysis  of 
complex  safety-critical  of  energy  systems  more  and  more 
demanding.  Safety  of  energy  systems  is  vital  to  society,  national 
development  and  people’s  life.  The  basic  safety  of  workers  on  the 
site  of  energy  project  is  guaranteed  first.  Safety  is  often  seen  as  one 
of  a  group  of  related  disciplines:  quality,  reliability,  availability, 
maintainability  and  safety.  The  criteria  are  specifically  defined 
when  sustainable  energy  DM.  Safety  can  be  a  technical  evaluation 
criteria  of  applied  technology  and  also  a  social  criteria  to  show 
their  effects  of  energy  systems  to  society  and  people,  etc.  [29,39- 
42,45,76,83,86]. 

2.1. 1.5.  Reliability.  Reliability  of  energy  systems  may  be  defined  to 
the  capacity  of  a  device  or  system  to  perform  as  designed;  the 
resistance  to  failure  of  a  device  or  system;  the  ability  of  a  device  or 
system  to  perform  a  required  function  under  stated  conditions  for 
a  specified  period  of  time;  or  the  ability  of  something  to  “fail  well” 
(fail  without  catastrophic  consequences).  Reliability  has  always 
been  a  concern  in  the  energy  sector.  Some  factors  and  events  are 
heightening  concern  about  energy  reliability,  such  as  political 
tensions,  high  profile  terrorist  activity,  and  massive  blackouts  [96- 
98].  The  quality  of  the  equipment,  its  maintenance,  the  type  of  fuel, 
the  design  of  the  energy  system  and  how  it  is  operated  play  a  great 
role  in  its  reliability.  Reliability  of  energy  systems  is  one  among  the 
essential  criteria  for  their  evaluations  [39-44,80,81,84].  It  can  be 
expressed  in  a  qualitative  scale  or  a  number,  such  as  realization 
time  in  [84]. 

2.1. 1.6.  Maturity.  Technical  maturity  is  a  criteria  to  evaluate  the 
applied  technology  of  energy  systems  [29,82,84].  Measuring  the 
degree  of  maturity  of  the  technology  can  refer  how  widespread  the 
technology  is  at  both  national  and  international  level.  In  detail,  the 
following  stages  can  be  considered:  (1)  technologies  that  are  only 
tested  in  laboratory;  (2)  technologies  that  are  only  performed  in 
pilot  plants,  where  the  demonstrative  goal  is  linked  to  the 
experimental  one,  referring  to  the  operating  and  technical 
conditions;  (3)  technologies  that  could  be  still  improved;  and 
(4)  consolidated  technologies,  which  are  close  to  reaching  the 
theoretical  limits  of  efficiency. 

Additionally,  there  are  some  particular  criteria  reflecting  the 
technology  of  energy  systems  or  equipments.  The  capacity  of  a 
power  plant  (it  is  defined  to  the  amount  of  electricity  that  it 


produces  over  a  period,  divided  by  the  amount  of  electricity  it 
could  have  produced  if  it  had  run  at  full  power  over  that  period) 
was  selected  to  evaluate  its  ability  [43,83-85].  Availability  of  fuel 
was  applied  to  [40,41]  evaluate  fossil  fuel,  solar  energy,  wind 
energy,  hydro-electric  and  nuclear  power  plants.  Also  the  ability  to 
respond  to  peak  load  was  employed  to  assess  alternative  scenarios 
for  the  power  generation  sector  in  Greece  [83].  Regulation  and 
control  properties  were  used  to  reflect  its  technical  performance 
[29]  and  knowledge  of  the  innovative  technology  was  employed  to 
show  its  development  [13].  The  reserves-to-production  ratio 
calculates  the  availability  (in  years)  of  a  certain  type  of  fuel 
according  to  current  consumption  and  the  annual  consumption 
increase/decrease  the  rate  of  each  non-renewable  energy  source 
for  electric  power  generation  [43]. 

2.1.2.  Economic  criteria 

2. 1.2.1.  Investment  cost.  Investment  cost  comprises  of  all  costs 
relating  to:  the  purchase  of  mechanical  equipment,  technological 
installations,  construction  of  roads  and  connections  to  the  national 
grid,  engineering  services,  drilling  and  other  incidental  construc¬ 
tion  work.  Labor  costs  or  costs  for  the  equipment  maintenance  are 
not  included  in  investment  costs.  Nuclear  and  coal-fired  units  are 
characterized  by  high  investment  costs  and  low  operating  costs 
while  gas-fired  generation  is  characterized  by  lower  capital  costs 
and  higher  operating  costs.  The  investors  must  consider  the 
investment  costs  and  the  benefit.  Investment  cost  is  the  most  used 
economic  criteria  to  evaluate  energy  systems  [11,13,29,30,35- 
45,74,76-78,83-87,92]. 

2. 1.2.2.  Operation  and  maintenance  cost.  Operation  and  mainte¬ 
nance  costs  consist  of  two  parts.  One  is  the  operation  cost  that 
includes  employees’  wages,  and  the  funds  spent  for  the  energy,  the 
products  and  services  for  the  energy  system  operation.  Another  is 
the  maintenance  cost  that  aims  to  prolong  energy  system  life  and 
avoid  failures  that  may  lead  to  its  operation  suspension.  The  funds 
spent  for  maintenance  are  less  than  the  financial  damage  obtained 
from  an  energy  system  failure  and  increase  the  credibility  and 
confidence  index  of  the  energy  system.  The  operation  and 
maintenance  costs  are  also  divided  into  two  subcategories:  fixed 
and  variable  costs.  Operation  and  maintenance  cost  is  another 
most  used  economic  criteria  [30,39-44,74,76,84-86,92]. 

2. 1.2. 3.  Fuel  cost.  Fuel  cost  refers  to  the  fund  spent  for  the 
provision  of  raw  material  necessary  (i.e.  uranium  for  nuclear 
power  plants)  for  energy  supply  system  operation.  Fuel  costs  may 
include  extraction  or  mining,  transportation  and  possible  fuel 
processing  to  be  used  in  a  power  plant.  Fuel  costs  may  vary 
considerably  in  different  time  periods  and  areas  as  a  result  of 
several  reasons,  including  demand,  production  and  policy  matters. 
The  fuel  is  the  essential  input  in  energy  system  as  shown  in  Fig.  1. 
Some  researchers  adopted  fuel  cost  to  evaluations  [11,38,40- 

43.77.78.87] .  Especially,  it  is  notable  that  the  fuel  cost  excludes 
from  operation  cost  when  fuel  cost  and  operation  and  maintenance 
cost  are  both  selected  to  evaluations. 

2. 1.2. 4.  Electric  cost.  Electric  cost,  which  is  the  product  cost  of 
power  plant,  was  seen  as  a  criteria  to  evaluate  its  economic 
performance  from  the  viewpoint  of  consumers  [30,35- 

37.77.83.87] .  Governments,  investors,  producers  and  consumers 
have  different  expectation  on  the  electric  cost.  It  is  necessary  to 
evaluate  the  electric  cost  of  different  energy  systems  rationally. 

2. 1.2. 5.  Net  present  value  (NPV).  NPV,  also  called  as  net  present 
worth  (NPW),  is  defined  as  the  total  present  value  of  a  time  series 
of  cash  flows.  It  is  a  standard  method  for  using  the  time  value  of 


2268 


J.-J.  Wang  et  al.  /  Renewable  and  Sustainable  Energy  Reviews  13  (2009)  2263-2278 


money  to  appraise  long-term  energy  projects.  Used  for  capital 
budgeting,  and  widely  throughout  economics,  it  measures  the 
excess  or  shortfall  of  cash  flows,  in  present  value  terms,  once 
financing  charges  are  met.  NPV  is  often  used  to  assess  its  feasibility 
of  an  energy  project  by  investor.  It  is  also  necessarily  considered  in 
early  stage  of  energy  DM  [29,45,88-90]. 

2. 2.2.6.  Payback  period.  Payback  period  of  an  energy  project  refers 
to  the  period  of  time  required  for  the  return  on  an  investment  to 
“repay”  the  sum  of  the  original  investment.  It  intuitively  measures 
how  long  something  takes  to  “pay  for  itself’;  shorter  payback 
periods  are  obviously  preferable  to  longer  payback  periods  to 
investor  [13,29,45,88].  Although  primarily  a  financial  term,  the 
concept  of  a  payback  period  is  occasionally  extended  to  energy 
payback  period  (the  period  of  time  over  which  the  energy  savings 
of  a  project  equal  the  amount  of  energy  expended  since  project 
inception). 

2. 2.2.7.  Service  life.  An  energy  system’s  service  life  is  its  expected 
lifetime,  or  the  acceptable  period  of  use  in  service.  Generally,  the 
energy  system  tire’s  life  follows  the  bathtub  curve,  to  boot.  After 
installation,  there  is  a  not-small  probability  of  failure.  Then,  the  tire 
will  perform,  given  no  defect-introducing  event  such  as  encoun¬ 
tering  a  road  hazard  (a  nail  or  a  pothole),  for  a  long  duration 
relative  to  its  expected  service  life.  After  a  period,  the  failure 
probability  will  rise  again.  Contrarily  to  payback  period,  longer 
service  life  is  preferable  to  investor  and  it  was  employed  to  select 
the  best  scheme  from  energy  system  alternatives  [30,36,76,85]. 

2. 2.2.8.  Equivalent  annual  cost  (EAC).  Equivalent  annual  cost  of 
energy  project  is  the  cost  per  year  of  owning  and  operating  an  asset 
over  its  entire  lifespan.  EAC  is  often  used  as  a  decision-making  tool 
in  capital  budgeting  when  comparing  investment  projects  of 
unequal  lifespan.  EAC  is  calculated  by  dividing  the  NPV  of  an 
energy  project  by  the  present  value  of  an  annuity  factor.  Some 
works  employed  EAC  as  an  evaluation  criteria  [29,45,88,91]. 

Expect  these  criteria,  the  special  criteria  were  applied  to  MCDA. 
In  some  literatures,  there  were  not  specific  environmental  criteria 
to  be  used  while  the  definite  cost  criteria  were  converted  due  to  the 
environmental  protection,  such  as  C02  emission  avoided  [44]  and 
environmental  constraints  cost  [39-42]. 

2.2.3.  Environmental  criteria 

2.2. 3.2.  NOx  emission.  NOx  is  a  generic  term  for  mono-nitrogen 
oxides  (NO  and  N02).  NOx  comprise  a  group  of  molecules  that  can 
contribute  to  local  air  pollution,  acid  deposition  and  global  climate 
change.  NOx  also  readily  reacts  with  ammonia,  moisture,  volatile 
organic  compounds,  common  organic  chemicals,  and  even  ozone, 
to  form  a  wide  variety  of  toxic  products  which  may  damage  the 
health  of  people  and  cause  biological  mutations.  Consequently, 
they  have  a  direct  impact  on  the  health  of  the  community  and  an 
indirect  impact  on  the  social  state  of  the  community.  NOx  is 
produced  during  the  combustion  of  fossil  fuels  and  biomass, 
especially  combustion  at  high  temperatures.  The  NOx  emission  of 
energy  system  is  popularly  selected  to  evaluate  its  performances 
[11,29,36-38,45,76,79-81,83,92]. 

2. 2.3.2.  C02  emission.  C02  is  a  colorless,  odorless  and  tasteless  gas 
that  is  about  one  and  a  half  times  as  dense  as  air  under  ordinary 
conditions  of  temperature  and  pressure.  It  was  reported  that  C02 
contributes  9-26%  to  the  greenhouse  effect  [99].  C02  is  mainly 
released  through  the  combustion  of  coal/lignite,  oil  and  natural  gas 
in  energy  systems.  The  disafforestation  in  the  world  lessen  the 
removal  of  atmospheric  C02  by  photosynthesis  and  also  con¬ 
tributes  to  the  greenhouse  effect.  Different  energy  systems  have 


different  C02  emissions.  For  example,  new  technology  combining 
cycles  burning  natural  gas  can  save  practically  33%  of  C02 
emissions  with  regard  to  conventional  cycles.  C02  leads  to  the 
global  warming,  which  is  focused  by  many  governments, 
academies,  and  researchers.  Naturally,  C02  emission  of  energy 
system  is  certainly  a  criteria  to  evaluate  its  sustainability 
[11,29,30,35-38,45,76-85,87,88,92]. 

2. 2.3.3.  CO  emission.  CO  is  produced  from  the  partial  combustion 
of  carbon-containing  compounds,  notably  in  internal-combustion 
engines.  Through  natural  processes  in  the  atmosphere,  it  is 
eventually  oxidized  to  carbon  dioxide.  Carbon  monoxide  has  an 
atmospheric  lifetime  of  only  a  few  months  [51]  and  as  a 
consequence  is  spatially  more  variable  than  longer-lived  gases. 
Likewise,  anthropogenic  CO  from  automobile  and  industrial 
emissions  may  contribute  to  the  greenhouse  effect  and  global 
warming.  In  literatures  [29,45,76]  CO  emission  was  selected  to 
characterize  the  performances  of  the  energy  systems. 

2 A. 3.4.  S02  emission.  S02  is  another  harmful  gaseous  emission  of 
coal/lignite,  oil  and  combined  cycle  natural  gas  power  plants. 
Further  oxidation  of  S02  forms  H2S04  and  thus  acid  rain  [100], 
which  is  one  of  the  causes  for  concern  over  the  environmental 
impact  of  the  use  of  these  fuels  as  power  sources.  S02  is  also 
associated  with  increased  respiratory  symptoms  and  disease, 
difficulty  in  breathing,  and  premature  death.  S02  can  be  chemically 
bound  in  flue  gas  desulfurization  and  the  U.S.  has  witnessed  a  33 
percent  decrease  in  emissions  between  1983  and  2002.  However, 
the  cost  is  considerable.  Consequently  the  environment-friendly 
energy  systems  need  higher  operation  costs  necessarily.  S02 
emission  can  be  selected  to  evaluate  its  contribution  to  environ¬ 
ment  [11,38,74,78-81,83]. 

2A.3.5.  Particles  emission.  Particles  emissions  to  the  atmosphere 
are  also  one  of  the  main  environmental  problems  of  the  energy 
industries.  These  emissions  are  mainly  released  by  coal/lignite  and 
oil  as  well  as  biomass  and  photovoltaic  power  plants  (during  their 
cell  construction).  Fine  particles  formed  in  the  atmosphere  by  the 
conversion  of  S02  and  NOx  emissions  scatter  light  and  create  hazy 
conditions,  decreasing  visibility  and  contributing  to  regional  haze. 
Particles  emission  is  also  a  worst  type  of  emission  for  human 
health.  The  risk  for  human  health  depends  on  size,  distribution, 
microstructure  and  chemical  composition  of  particulate  released 
into  the  atmosphere  [80].  The  particle  size  and  type,  etc,  depends 
on  the  fuel  of  energy  systems  [101-103]  so  that  some  energy 
systems  were  evaluated  in  the  criteria,  particles  emission  [78-82]. 

2A.3.6.  Non-methane  volatile  organic  compounds  (NMVOCs).  NM- 
VOC  is  a  generic  term  for  a  large  variety  of  chemically  different 
compounds,  like  for  example,  benzene,  ethanol,  formaldehyde, 
cyclohexane,  or  acetone.  Essentially,  NMVOCs  are  identical  to 
volatile  organic  compounds  (VOCs),  but  with  methane  excluded. 
Sometimes  NMVOC  is  also  used  as  a  sum  parameter  for  emissions, 
where  all  NMVOC  emissions  are  added  up  per  weight  into  one 
figure.  In  the  absence  of  more  detailed  data,  this  can  be  a  very 
coarse  parameter  for  pollution,  e.g.  for  summer  smog  or  indoor  air 
pollution.  Chatzimouratidis  and  Pilavachi  selected  NMVOCs  to 
evaluate  the  power  plants  [43,79-81]. 

2 A. 3. 7.  Land  use.  Energy  system  occupies  some  land.  The  land 
required  by  each  plant  is  a  matter  of  great  concern  for  their 
evaluation  [29,35,36,76,77,80-82,86,87].  The  environment  and 
landscape  are  affected  directly  by  the  land  occupied  by  energy 
systems.  Land  use  can  also  be  a  social  criteria  to  evaluate  the 
energy  system.  It  represents  one  of  the  most  critical  factors  for  the 
intervention  site,  especially  where  the  human  activities  are 
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relevant  factors  of  environmental  pressure  [82].  Quality  of  people’s 
life  is  affected  by  energy  systems  as  it  could  have  been  used  for  the 
creation  of  parks  and  recreation  centers.  The  excavations,  tunnels 
and  other  work  necessary  for  energy  systems  operation  destabilize 
the  flora,  the  fauna  and  the  ecosystem  in  general.  Different  energy 
systems  occupy  different  land  while  the  products  are  same. 
Particularly  energy  supply  systems  with  biomass  and  biofuels 
require  the  large  amount  of  land.  Land  use  is  necessarily 
considered  to  energy  DM. 

2 A 3.8.  Noise.  Noise  pollution  from  energy  systems  is  displeasing 
machine-created  sound  that  disrupts  the  activity  or  balance  of 
human  or  animal  life.  It  not  only  leads  to  the  environmental  effects, 
but  also  damage  physiological  and  psychological  health  of  human. 
Especially,  chronic  exposure  to  noise  in  working  area  of  energy 
plants  may  cause  noise-induced  hearing  loss.  Noise  can  be  an 
environmental  criteria  or  social  criteria  to  evaluate  energy  systems 
[29,45,76,84-86]. 

Additionally,  some  particular,  pertinent  and  distinctiveness 
criteria  reflecting  the  energy  systems’  contributions  to  environ¬ 
ment  were  used.  For  instance,  depletion  of  abiotic  resources 
human  toxicity,  ecotoxicity,  photo-oxidant  formation  and  eutro¬ 
phication  were  used  for  natural  gas  energy  solutions  evaluation 
[44].  Visual  impact  reflects  the  visual  nuisance  that  may  be  created 
by  the  development  of  an  energy  project  in  a  specific  area  and  it 
was  used  for  evaluating  the  various  wind  energy  plant  alternatives 
proposed  [84]. 

Except  for  these  idiographic  criteria,  there  are  some  recapitu¬ 
lative  criteria  in  the  sustainable  energy  decision-making,  such  as 
effects  on  natural  environment  [13,74,85,90],  climate  change 
[13,44,86,91]  and  acidification  [44,91].  These  criteria  do  not 
characterize  the  performances  or  contributions  in  only  numerical 
data  or  aspect.  For  example,  Both  NOx  emission  and  S02  emission 
contribute  acid  rain  while  acidification  including  the  two  criteria  is 
used  to  evaluate  energy  systems. 

2 A. 4.  Social  criteria 

Social  aspects  were  definitely  the  most  important  criteria  for 
people’s  acceptance  of  energy  systems  during  the  past  decades. 
Table  4  summarizes  the  key  social  criteria  of  energy  supply 
systems  in  the  literature. 

2 AAA.  Social  acceptability.  Social  acceptability  expresses  the 
overview  of  opinions  related  to  the  energy  systems  by  the  local 
population  regarding  the  hypothesized  realization  of  the  projects 
under  review  from  the  consumer  point  of  view.  It  is  extremely 
important  since  the  opinion  of  the  population  and  of  pressure 
groups  may  heavily  influence  the  amount  of  time  needed  to  go 
ahead  with  and  complete  an  energy  project.  Social  acceptance  is 
not  expressed  as  a  measurable  figure.  It  is  not  a  quantitative 
criteria  but  a  qualitative  one.  Qualitative  measures  of  alternatives 
against  the  criteria  can  be  obtained  according  to  the  results  of  the 
survey  carried  out  in  the  local  community  or  city.  Social 
acceptability  was  employed  to  analyze  their  feasibilities  of  CHP, 
renewable  energy  power  plants,  etc.  [78,80,81,84]. 

2 A. 4.2.  Job  creation.  Energy  supply  systems  employ  many  people 
during  their  life  cycle,  from  construction  and  operation  till 
decommissioning.  The  energy  systems  are  closely  related  to  the 
society  shown  in  Fig.  1.  Local  societies  where  energy  systems  were 
established  based  their  development  and  prosperity  on  them  for 
many  decades.  The  sustainable  energy  system  creating  more  jobs 
for  people  is  beneficial  to  improve  the  living  quality  of  local 
peoples  [80].  In  the  DM  process  of  local  governments,  job  creations 
of  energy  systems  are  indispensably  considered  and  are  selected  to 
evaluate  their  contributions  [13,36,38,80-82,86,89,90]. 


2 A. 4.3.  Social  benefits.  Social  benefits  were  definitely  the  most 
important  criteria  for  people’s  life  during  the  past  decades.  The 
criteria  express  the  social  progress  in  the  local  regions  by 
introducing  an  energy  project,  especially  in  the  less  developed 
regions.  Social  benefit  is  also  a  qualitative  criteria  and  not 
expressed  as  a  measurable  figure.  The  criteria  is  a  recapitulative 
criteria,  but  some  actual  items  can  express  it,  such  as  job  creations, 
social  life  and  income  generation  [104].  Social  benefits  were 
directly  used  to  aid  in  the  sustainable  energy  DM  [13,39-42]. 

Furthermore,  some  researchers  have  employed  some  particular 
and  recapitulative  criteria  aid  in  sustainable  energy  DM.  National 
economy  was  introduced  to  evaluate  the  contributions  of  the 
energy  systems  to  national  economy  and  social  development  [40- 
42].  Health  social  criteria  were  applied  to  select  the  best  CHP 
alternative  in  Croatia  because  the  NOx  emission  of  energy  systems 
has  a  direct  impact  on  the  health  of  the  community  [78].  Also 
compensation  rate  aims  at  restoring  people’s  degradation  of 
quality  of  life  and  was  used  to  assess  power  plants  [80].  Energy  use 
per  household,  share  of  household  income  spent  on  fuel  and 
electricity,  number  of  injured  per  energy  produced  and  number  of 
working  hours  per  energy  produced  were  used  to  analyze  five 
scenarios  of  sustainable  energy  systems  in  Belgrade  [11]. 
Compatibility  with  political,  legislative  and  administrative  frame¬ 
work  was  adopted  to  decide  the  diffusion  of  renewable  energy 
technology  with  regard  to  government  support,  the  tendency  of 
institutional  actors,  and  the  policy  of  public  information  [82]. 
Advanced  performance  and  maintenance  convenience  were  used 
to  show  their  contributions  of  the  energy  technologies  to  social 
development  [29,45,76]. 

2.2.  Methods  of  criteria  selection 

There  are  various  criteria  to  show  the  performance  of  energy 
system.  It  is  not  absolute  that  more  and  more  criteria  are  helpful  to 
the  sustainable  energy  decision-making.  Likewise,  less  criteria  are 
beneficial  to  the  evaluation  of  energy  systems.  Furthermore,  there 
are  repeatability  and  relevancy  in  the  criteria  system,  such  as  the 
inclusion  of  fuel  cost  in  operation  and  maintenance  cost,  and  job 
creations  and  social  benefits  of  energy  project.  Generally,  the 
following  principles  are  obeyed  to  select  the  “major”  criteria  used 
to  energy  decision-making  [105,106]: 

(1)  Systemic  principle.  The  criteria  system  should  roundly  reflect 
the  essential  characteristic  and  the  whole  performance  of  the 
energy  systems.  The  comprehensive  evaluation  function  of 
multi-criteria  can  obtain  better  results  than  the  sum  of  single 
criteria  evaluations. 

(2)  Consistency  principle.  The  criteria  system  should  be  consistent 
with  the  DM  objective. 

(3)  Independency  principle.  The  criteria  should  not  have  inclusion 
relationship  at  the  same  level  criteria.  The  criteria  should 
reflect  the  performance  of  alternatives  from  different  aspects. 

(4)  Mensurability  principle.  The  criteria  should  be  measurable  in 
quantitative  value  as  possible  or  qualitatively  expressed. 

(5)  Comparability  principle.  The  DM  result  is  more  rational  when 
the  comparability  of  criteria  is  more  obvious.  Additionally,  the 
criteria  should  be  normalized  to  compare  or  operate  directly 
when  there  are  both  benefit  criteria  and  cost  criteria. 

These  principles  give  the  instruction  to  the  decision-makers  to 
select  criteria.  However,  these  principles  are  difficult  to  follow  and 
some  “minor”  criteria  may  be  chosen.  Therefore  it  is  necessary  that 
some  rational  methods  are  applied  to  select  the  “major”  criteria, 
distinguish  the  main  and  secondary  and  construct  the  reasonable 
criteria  systems.  The  following  elementary  selection  methods  of 
criteria  used  to  sustainable  energy  DM  are  introduced: 
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2.2 A.  Delphi  method 

The  Delphi  method  is  a  systematic  and  interactive  method, 
which  relies  on  a  panel  of  independent  experts  [105-107].  Delphi 
is  based  on  the  principle  that  forecasts  from  a  structured  group  of 
experts  are  more  accurate  than  those  from  unstructured  groups  or 
individuals  [108].  The  carefully  selected  experts  answer  ques¬ 
tionnaires  for  criteria  selection  to  evaluate  energy  systems  in  two 
or  more  rounds.  After  each  round,  the  summaries  of  the  experts’ 
selection  from  the  previous  round  as  well  as  the  reasons  they 
provided  for  their  judgments  are  fed  back  to  the  experts.  Thus, 
participants  are  encouraged  to  revise  their  earlier  answers  in  light 
of  the  replies  of  other  members  of  the  group.  It  is  believed  that 
during  this  process  the  range  of  the  selected  criteria  will  decrease 
and  the  group  will  converge  towards  the  “correct”  criteria.  Finally, 
the  process  is  stopped  after  a  pre-defined  stop  criteria  (e.g.  number 
of  rounds,  achievement  of  consensus,  and  stability  of  results). 
Delphi  has  been  widely  used  in  social,  ecological  and  economic 
works.  Similarly,  Delphi  method  can  also  be  applied  in  the 
weighting  and  evaluation  in  the  latter  Sections  3  and  4. 

2.2.2.  Least  mean  square  (LMS)  method 

The  principle  of  LMS  method  is  that  one  criteria  contributes  less 
importance  to  results  and  it  can  be  ignored  when  its  performances 
of  alternatives  are  almost  same  or  near  although  the  criteria  is  vital 
in  evaluation  [105,107].  To  lessen  its  relativity  with  other  criteria, 
the  criteria  can  be  removed.  Let 


u 


where  is  the  i-th  sample  of  the  j-th  criteria,  i  =  1,  2,  . . .,  m,  and 

=  (V"0  £”i 

If  there  exists  k  to  make  sk  =  mini  </<n{Sj}  and  sk^  0,  the  k 
criteria  that  corresponds  to  sk  can  be  removed.  This  method  can  be 
also  used  to  elicit  the  selected  weights  in  Section  3  (the  m 
alternative  in  the  selected  n  criteria  form  to  the  new  group  decision 
matrix  and  then  the  calculated  standard  deviation  in  Eq.  (2)  again 
is  normalized  to  get  the  weights). 


2.2.3.  Minmax  deviation  method 

Minmax  deviation  method  is  similar  to  LMS  method  [105,107]. 
The  judgment  standard  is  the  deviation  values  of  criteria.  The 
maximum  deviation  of  criteria  Xj  can  be  calculated  as 

r,-  =  max  {lx,/ - X/,- 1)  (3) 

J  1  <i./<mu  J  JU 


between  criteria  Q  and  criteria  Cj  can  be  calculated  as 
 cov(C/,  Cj) 


where  cov(Q,C?)  is  the  covariance  of  Q  and  C;,  and  Sc.  and  Sc.  are  the 
standard  deviation  of  Q  and  Cj  respectively. 

The  correlation  coefficients  between  n  criteria  can  form  to  a 
n  x  n  matrix,  ftnxn.  When  r{j  =  1 ,  criteria  C,  are  completely  related  to 
criteria  Cj.  However,  the  correlation  coefficient  includes  more  or 
less  influence  because  other  criteria  are  not  constant.  To  reflect  the 
interaction  well,  the  partial  correlation  coefficient  is  considered  to 
determine  the  interaction  between  criteria  and  computed  as 


where  %  Ru  and  %  are  algebraic  complements  of  elements,  rijt  r„ 
and  Vjj,  in  matrix  Rnxn-  Greater  the  partial  correlation  coefficient  is, 
more  correlative  the  two  criteria.  When  =  1 ,  criteria  Q  is 
completely  related  to  criteria  Q  and  one  of  the  two  criteria  can  be 
removed. 

Based  on  the  elementary  methods,  some  specific  methods  were 
developed  and  extended  to  various  complex  systems,  such  as  grey 
relational  method  [109,110],  analytic  hierarchy  process  (AHP) 
[111,112],  clustering  method  [105],  principal  component  analysis 
[113]  and  rough  set  method  [110].  The  principle  of  all  selection 
methods  is  to  eliminate  the  relevance  between  criteria  and  select 
the  independent  criteria.  Grey  relational  method  and  AHP  are  also 
MCDA  methods  applied  to  get  the  ranking  order  of  energy  systems 
alternatives  and  the  detailed  introduction  can  be  found  in  Section  4 
of  this  article. 


3.  Weighting  methods 

All  factors  have  their  internal  impact  reclassified  to  a  common 
scale  so  that  it  is  necessary  to  determine  each  criteria’s  relative 
impact  in  the  sustainable  energy  DM  problem.  Weight  is  assigned 
to  the  criteria  to  indicate  its  relative  importance.  Different  weights 
influence  directly  the  DM  results  of  energy  systems’  alternatives. 
Consequently,  it  is  necessary  to  obtain  the  rationality  and  veracity 
of  criteria  weights.  Three  factors  are  usually  considered  to  obtain 
the  weights:  the  variance  degree  of  criteria,  the  independency  of 
criteria,  and  the  subjective  preference  of  the  decision-makers. 

Generally  there  are  two  methods:  the  equal  weights  and  the 
rank-order  weights  [114].  The  methods  have  been  both  applied  in 
sustainable  energy  DM  shown  in  Table  2. 


Likewise,  if  there  exists  k  to  make  rk  =  min1<J<n{rJ  }  and  rk  «  0, 
the  k  criteria  that  correspond  to  rk  can  be  removed.  Similarly,  This 
method  can  be  also  used  to  elicit  weights. 

2.2.4.  Correlation  coefficient  method 

Correlation  analysis  adopts  the  correlation  coefficient  to  show 
the  interaction  between  criteria.  The  correlation  coefficient 


(1)  Equal  weights  method 

The  criteria  weight  in  equal  weights  method  is  defined  as 
Wj  =  l  i  =  1,2, ...  ,n,  (6) 

The  method  requires  minimal  knowledge  of  the  decision¬ 
maker’s  priorities  and  minimal  input  from  decision  maker.  The 


Table  2 

The  reviewed  weighting  methods  for  sustainable  energy  DM. 
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equal  weights  method  was  popularized  and  applied  in  many 
decision-making  problems  since  Dawes  and  Corrigan  argued 
that  this  method  often  produced  the  results  nearly  as  good  as 
those  optimal  weighting  methods  in  1974  [115].  Equal  weights 
method  is  the  most  popular  in  sustainable  energy  DM  [30,35- 
38,44,54,78,83,91]. 

(2)  Rank-order  weighting  method 

The  equal  weights  method  has  also  been  criticized  because 
it  ignores  the  relative  importance  among  criteria.  Following 
this  argument,  the  rank-order  weighting  method  was  proposed 
and  criteria  weights  are  distributed  as 

Wi  >  w2  >  •  •  •  >  wn  >  0  (7) 

where  Ya=\  w*  =  1 . 

The  rank-order  weighting  methods  are  classified  into  three 
categories:  subjective  weighting  method,  objective  weighting 
method  and  combination  weighting  method.  Criteria  weights 
determined  by  the  subjective  weighting  methods  depend  only 
on  the  preference  of  decision-makers,  not  on  the  quantitative 
measured  data  of  energy  projects.  Contrarily,  the  objective 
weights  are  obtained  by  mathematical  methods  based  on  the 
analysis  of  the  initial  data.  The  subjective  weighting  methods 
explain  the  evaluation  clearly  while  the  objectivity  ones  are 
relatively  weak.  Additionally,  the  judgments  of  decision¬ 
makers  sometimes  absolutely  depend  on  their  knowledge  or 
information.  Thus,  the  criteria  weights’  errors  in  some  extent 
are  unavoidable.  As  we  can  see,  none  of  the  two  approaches  is 
perfect.  It  may  be  suggested  that  an  integrated  method  could 
be  most  appropriate  for  determining  the  criteria  weights. 
Currently,  a  number  of  combination  or  optimal  weighting 
methods  were  proposed  and  developed. 

The  weighting  stage  in  Fig.  2  also  displays  the  process  that 
combined  three  weighting  categories.  First,  the  subjective  weights 
are  determined  by  experts  and  the  concordance  of  criteria  values  is 
checked  by  the  decision-maker.  When  the  concordance  index  is 
not  sufficiently  high,  more  experts  are  needed  to  modify  the 
subjective  weights  to  get  the  high  concordance.  Then,  the  objective 
weights  of  criteria  are  calculated  in  measured  data.  Finally,  the 
concordance  of  subjective  and  objective  weights  is  checked  in  a 
similar  way.  If  the  concordance  cannot  get  satisfied,  the  combina¬ 
tion  methods  are  applied  to  determine  the  integrated  weights  of 
criteria. 

Table  3  summarizes  the  weighting  methods  in  the  MCDA  DM 
[105,107,116,117].  The  basic  and  representative  methods  are 
presented  in  this  article  and  other  methods  can  be  found  detailedly 
in  others  referred  literatures. 

3.2.  Subjective  weighting  methods 

Subjective  weighting  methods  such  as  pair-wise  comparison 
[29,39,40,60,74,76,87],  AHP  [33,41-43,57,79-81]  and  Simos 
[32,82,86],  were  the  most  used  methods  in  sustainable  energy 
DM.  Especially,  priority  given  to  one  indicator  with  others  being 
the  same  was  employed  to  protrude  the  performances  in  one 
aspect  in  literatures  [30,35-38,54,78].  The  following  part  intro¬ 
duces  briefly  several  representative  subjective  weighting  methods. 

3.2.2.  Simple  multi- attribute  rating  technique  (SMART) 

SMART  was  originally  described  as  the  whole  process  of  rating 
alternatives  and  weighting  criteria  by  Edwards  in  1977  [118].  The 
participants  are  asked  to  rank  the  importance  of  the  changes  in  the 
criteria  from  the  worst  criteria  levels  to  the  best  levels.  Then  they 
assign  10  points  to  the  least  important  criteria,  and  increasing 
number  of  points  (without  explicit  upper  limit)  are  assigned  to  the 
other  criteria  to  address  their  importance  relative  to  the  least 


Table  3 

Weighting  methods  in  MCDA  DM. 


Categories 

Weighting  methods 

Subjective 

Simple  multi-attribute 

weighting 

rating  technique  (SMART) 
SMARTER 

Swing 

Trade-off 

SIMOS 

Pair-wise  comparison 

AHP 

Least-square  method 
Eigenvector  method 

Delphi  method 

Consistent  matrix  analysis 
PATTERN 

Objective 

Least  mean  square  (LMS) 

weighting 

method 

Minmax  deviation  method 
Entropy  method 

TOPSIS  method 

Vertical  and  horizontal 
method 

Variation  coefficient 
Multi-objective 
optimization  method 
Multiple  correlation 
coefficient 

Principal  component 
analysis 

Combination 

Multiplication  synthesis 

weighting 

Additive  synthesis 

Optimal  weighting  based  on 
sum  of  squares 

Optimal  weighting  based  on 
minimum  bias 

Optimal  weighting  based  on 
relational  coefficient  of  gradation 

important  criteria.  The  weights  are  calculated  by  normalizing  the 

sum  of  the  points  to  one.  Edwards  and  Barron  listed  the 
shortcomings,  stressed  that  weights  should  clearly  be  related  to 
the  criteria  ranges  in  1994  [119]  and  presented  an  improved 
version,  SMARTER.  The  idea  of  SMARTER  is  to  use  the  centroid 
method  so  that  the  weight  of  a  criteria  ranked  to  be  ith  is 


k=i 

3.1.2.  SWING 

With  the  SWING  weighting  method  [114,120],  the  decision 
maker  begins  by  rank  ordering  criteria  in  terms  of  their  associated 
value  ranges.  First  the  respondent  is  asked  to  select  the  criteria  that 
he  would  most  prefer  to  change  from  its  worst  to  its  best  level  and 
to  assign  100  points  to  this  most  important  criteria.  Then  the 
respondent  is  continued  to  choose  the  criteria  change  from  the 
worst  to  the  best  level  which  he  considers  to  be  the  second  most 
desirable  improvement  and  to  assign  points  less  than  100  to  that 
criteria  change.  Proceeding  in  this  fashion,  the  decision  maker 
ranks  all  criteria  and  assigns  relative  importance  points  to  their 
value  ranges.  Finally  the  given  points  are  normalized  to  sum  up  to 
one  to  get  the  criteria  weights.  The  SWING  method  is  an  algebraic, 
decomposed,  direct  procedure. 

3.2.3.  SIMOS 

The  main  innovation  in  this  approach  proposed  by  Simos  in 
1990  [121]  consists  of  associating  a  “playing  card”  with  each 
criteria.  The  participants  are  asked  to  rank  these  cards  (or  criteria) 
from  the  least  important  to  the  most  important.  The  rank  order  of  a 
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criteria  expresses  the  importance  a  single  participant  wants  to 
ascribe  to  that  criteria:  the  first  criteria  in  the  ranking  is  the  least 
important  and  the  last  criteria  in  the  ranking  is  the  most  important. 
If  the  two  criteria  are  found  to  be  equally  important,  these  are 
given  the  same  rank  position.  In  order  to  allow  participants  to 
express  strong  preference  between  criteria,  another  set  of  cards 
(white  cards)  is  introduced.  The  participants  are  asked  to  introduce 
white  cards  between  two  successive  colored  cards,  while  the 
number  of  white  cards  is  proportional  to  the  difference  between 
the  importance  of  the  considered  criteria.  Subsequently,  the 
criteria  weights  are  calculated  using  the  rank  positions  attributed 
in  the  previous  step:  the  rank  positions  are  simply  divided  by  the 
total  sum  of  the  positions  of  the  considered  criteria,  thus  providing 
a  vector  of  weights  to  be  applied  to  the  evaluation  criteria,  in  the 
form  of  real  values  summing  up  to  1. 

3A.4.  Pair-wise  comparison 

In  the  pair-wise  comparison  method,  participants  are  presented 
a  worksheet  and  are  asked  to  compare  the  importance  of  two 
criteria  at  a  time:  “Which  one  of  these  two  criteria  is  more 
important,  and  how  much  more  important?”  Then  the  relative 
importance  is  scored.  The  scales  can  be  various,  for  example,  a  scale 
of  0  (equal  importance)  to  3  (absolutely  more  important)  is 
commonly  adopted.  The  results  are  consolidated  by  adding  up  the 
scores  obtained  by  each  criteria  when  preferred  to  the  criteria  it  is 
compared  with.  The  results  are  then  normalized  to  a  total  of  1.0. 
This  weighting  method  provides  a  framework  for  comparing  each 
criteria  against  all  others,  and  helps  to  show  the  difference  in 
importance  between  criteria.  However,  it  does  not  allow  you  to 
check  the  consistency  of  participants’  preferences,  especially,  their 
transitivity.  You  should  therefore  examine  the  results’  matrices  for 
each  participant  to  check  for  major  problems. 

3.1.5.  AHP 

AHP  method  builds  on  the  pair-wise  comparison  model  for 
determining  the  weights  for  every  unique  criteria.  AHP  was 
proposed  primarily  by  Saaty  in  1980  [122,123].  The  matrix  of  pair¬ 
wise  comparisons  when  there  are  n  criteria  at  a  given  level  can  be 
formed  as: 


rc,/c, 

c,/c2  • 

■■  C,/C„- 

c2/ci 

C2/C2  • 

••  C2/Cn 

_Cn/C, 

C„/C2  ■ 

Cn/Cn _ 

The  relative  importance  can  be  scaled  in  Table  4.  Based  on  the 
matrix,  criteria  weights  can  be  calculated  in  some  methods,  such  as 
arithmetic  mean  method,  characteristic  root  method,  and  least 
square  method  [124].  Because  individual  judgments  will  never 
agree  perfectly,  the  degree  of  consistency  achieved  in  the  pair-wise 
comparison  is  measured  by  a  consistency  ratio  indicating  whether 
the  comparison  made  is  sound. 


3.2.  Objective  weighting  methods 

The  objective  weighting  method  elicits  the  criteria  weights 
using  the  measurement  data  and  information  and  reflects  the 
difference  degree.  The  literatures  about  objective  weighting 
methods  applied  in  sustainable  energy  DM  are  seldom  in  the 
reviewed  published  papers  while  the  objective  weighting  methods 
were  widely  applied  to  other  evaluation  systems,  such  as  social 
and  ecological  systems.  Only  entropy  method  was  employed  to 
elicit  the  weights  [60,76,87]  in  energy  projects.  The  typical 
objective  weighting  methods  are  presented  as  follows. 


3.2.1.  Entropy  method 

The  entropy  shows  that  how  much  the  criteria  reflects  the 
information  of  system  and  how  great  the  uncertainty  of  criteria  is. 
A  vector  of  Xj  =  (xlj-,x2j  ,  •••,xmj-)  characterizes  the  set  X  in  terms  of 
the  i-th  criteria,  defined  as  follows: 


m 

Xj  =  5>y,  j  =  1,2,...  ,n  (10) 

i=\ 

Then  the  entropy  measure  of  j-th  criteria  contrast  intensity  is 


Finally,  the  normalized  weights  can  be  calculated  as 


Wj  = 


1  ~ej 


£"=,  (1  -  ej) 


(11) 


(12) 


3.2.2.  Technique  for  order  preference  by  similarity  to  ideal  solution 
(TOPSIS)  method 

The  principle  of  TOPSIS  [126]  is  that  the  selected  best 
alternative  should  have  the  shortest  distance  from  the  positive 
ideal  solution  in  geometrical  sense.  The  weighted  distance 
between  alternative  A{  and  the  ideal  solution  A*  is  defined  as 
follows: 

hi  =  YlWj(XU  -Xp2  (13) 

J=1 

Then  the  following  optimal  model  is  solved  and  the  weights  can 
be  elicited. 


m  m  n 

min5>  = 

i=  1  i=  1  j=  1 

n 

s.t.  =  1 ,  Wj>  0 

j=  1 


(14) 


3.2.3.  Vertical  and  horizontal  method 

Vertical  and  horizontal  method  is  also  an  optimal  weighting 
method.  The  weights  can  be  solved  from  the  optimal  mathematic 


Table  4 

The  AHP  pair-wise  comparison  scale  [125]. 


Intensity  of  weight 

Definition 

Explanation 

1 

Equal  importance 

Two  criteria  contribute  equally  to  objectives 

3 

Weak/moderate  importance  of  on  over  another 

Experience  and  judgment  slightly  favored  one  criteria  over  another 

5 

Essential  or  strong  importance 

Experience  and  judgment  strongly  favor  one  criteria  over  another 

7 

Very  strong  or  demonstrated  importance 

A  criteria  is  favored  very  strongly  over  another;  its  dominance  demonstrated  in  practice 

9 

Absolute  importance 

The  evidence  favoring  one  criteria  over  another  is  of  the  highest 
possible  order  of  affirmation 

2, 4, 6, 8 

Reciprocals  of  above 
non-zero  number 

Intermediate  values  between  the  two 
adjacent  scale  values 

Used  to  represent  compromise  between  the  priorities  listed  above 

If  criteria  i  has  one  of  the  above  non-zero  numbers  assigned  to  it  when  compared 
to  criteria  j,  then  j  has  the  reciprocal  value  when  compared  with  criteria  I 

J.-J.  Wang  et  al. / Renewable  and  Sustainable  Energy  Reviews  13  (2009)  2263-2278 


Table  5 

The  reviewed  MCDA  methods  for  sustainable  energy  DM. 
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Categories 

MCDA  methods 

Literatures 

Total  number 

Elementary 

Weighted  sum 

[11,35-38,54,71,73,77,78] 

10 

Unique  synthesizing  criteria 

AHP 

[30,33,41  -43,49,50,52,57,74,79-81  ] 

13 

Fuzzy  set  methodology 

[13,26,29,39,40,55,60,72,84,127] 

10 

Grey  relational  method 

[45,60,76,87] 

4 

Outranking 

Preference  ranking  organization  method  for  enrichment  evaluation 
(PROMETHEE) 

[55,83,86,89,90] 

5 

Elimination  et  choice  translating  reality  (ELECTRE) 

[32,46,47,65,66,75,82,88,90] 

9 

Others 

NAIADE 

[44,84] 

2 

MACBETH 

[85] 

1 

Preference  assessment  by  imprecise  ratio  statements  (PAIRS) 

[91] 

1 

model  as: 


m  > 

maxs*  =  ^(z,-  -z)2/m 
i= 1 

n 

s.t.  Ywj  =  1,  Wj>  0 
j= 1 


(15) 


where  z*  =  ^)”=1  WjX/j  and  z  =  (1/m)  z/- 

TOPSIS  method  and  vertical  and  horizontal  method  both  reflect 
the  difference  of  alternatives’  whole  performances  as  possible, 
while  LMS  method,  minmax  deviation  method  and  entropy 
method  reflect  the  criteria  relative  importance  based  on  the 
difference  of  alternatives  to  a  criteria.  In  another  word,  TOPSIS 
method  and  vertical  and  horizontal  method  base  on  the  integrated 
evaluation  values  while  other  methods  base  on  the  difference  of 
single  criteria. 


3.3.  Combination  weighting  methods 


Combination  weighting  methods  were  gradually  applied  to  the 
evaluation  and  comparison  of  complex  systems,  including  energy 
projects  [76,79,87].  The  methods  have  two  basic  combinations: 
multiplication  synthesis  and  additive  synthesis.  The  principle  of 
multiplication  synthesis  is  expressed  as 


WUW2  j 

1  E"=1W1jW2j 


(16) 


where  w1;-,  w2j  and  Wj  are  subjective  weight,  objective  weight  and 
combination  weight  of  the  jth  criteria  respectively. 

While  the  additive  synthesis  is  written  as 


Wj  =  kw-Lj  +  (1  -  k)w2j  (17) 

where  k  is  the  linear  combination  coefficient  and  k  >  0. 

The  combination  coefficient  can  be  determined  by  various 
methods,  such  as  optimization  based  on  sum  of  squares,  minimum 
bias  and  relational  coefficient  of  gradation.  For  example,  the  linear 
combination  coefficient  was  solved  in  Jaynes  maximal  entropy 
theory  and  the  optimization  method  and  the  criteria  weights  were 
obtained  to  be  used  to  select  the  best  CCHP  scheme  from 
alternatives  [76]. 


4.  Multi- criteria  decision  analysis  methods 

It  is  the  turn  to  determine  the  preference  orders  of  alternative 
after  determining  the  criteria  weights  so  that  MCAD  methods  are 
employed  to  get  the  ranking  order  in  Eq.  (1).  In  the  referred 
literatures,  the  listed  MCDA  methods  in  Table  5  were  mainly 
applied  in  all  kinds  of  sustainable  energy  DM  problems 
[11,13,29,30,32,33,35-47,49,50,52,54,55,57,60,65,66,71-91],  such 


as  the  selection  of  CCHP  alternatives,  the  comparisons  of  renew¬ 
able  energy  plants  and  the  DM  of  energy  policy. 

Table  6  also  summaries  all  related  MCDA  methods  that  are 
divided  into  three  categories:  elementary  methods,  methods  in 
unique  synthesizing  criteria  and  outranking  methods.  An  overview 
of  several  typical  MCDA  methods  in  energy  systems  is  provided 
here.  A  more  detailed  analysis  of  the  theoretical  foundations  of 
theses  methods  can  be  found  in  [106,107,124,128]  and/or  other 
references. 

4.1.  Elementary  methods 

The  elementary  methods  in  Table  6  includes  ten  methods,  the 
former  three  methods  are  defined  as  non-preference  information 
methods  without  decision  maker,  and  other  methods  are  multi¬ 
attribute  information  methods  with  decision  maker.  Conjunctive 
and  disjunctive  methods  belong  to  screening  methods  that  the 
acceptable  alternative  must  exceed  given  performance  thresholds 
for  all  criteria.  Lexicographic,  elimination  by  aspects  and  linear 
assignment  method  are  ordinal  partiality  methods.  The  latter  two 
methods  need  the  criteria  preference  of  decision  maker. 

4.1.1.  Weighted  sum  method  (WSM) 

WSM  is  the  most  commonly  used  approach  in  sustainable 
energy  systems  [11,35-38,54,71,73,77,78].  The  score  of  an 


Table  6 

MCDA  methods. 


Categories 

Weighting  methods 

Elementary 

Dominance 

Maximin 

Maximax 

Conjunctive 

Disjunctive 

Lexicographic 

Elimination  by  aspects 

Linear  assignment 

Weighted  additive 

Weighted  product 

Unique  synthesizing  criteria 

Analytical  hierarchy  process  (AHP) 
TOPSIS 

SMART 

Grey  relational  analysis 

Data  envelopment  analysis 
Multi-attribute  value  theory  (MAVT) 
Multi-attribute  utility  theory  (MAUT) 
Utility  theory  additive  (UTA) 

Fuzzy  weighted  sum 

Fuzzy  maximum 

Outranking 

ELECTRE  I,  IS,  II,  III,  IV,  TRI 
PROMETHEE  I,  II 

ORESTRE 
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alternative  is  calculated  as 

n 

Si  =  J2wJx'J’  !  =  (18) 

J= i 

Then  the  resulting  cardinal  scores  for  each  alternative  can  be 
used  to  rank,  screen,  or  choose  an  alternative.  The  best  alternative 
is  the  one  whose  score  is  the  maximum. 


4.1.2.  Weighted  product  method  (WPM) 

The  WPM  is  similar  to  WSM.  The  main  difference  is  that  instead 
of  addition  in  the  calculation  there  is  multiplication.  The  score  of 
alternative  i  can  be  calculated  as: 


i  =  1,2, . . .  ,m 


(19) 


Naturally,  the  alternative  having  the  maximum  score  is  the  best 
scheme.  Because  of  the  exponent  property,  this  method  requires  all 
ratings  be  greater  than  1.  For  example,  when  a  criteria  has 
fractional  ratings,  all  ratings  in  that  criteria  are  multiplied  by  10m 
to  meet  this  requirement.  Alternative  scores  obtained  by  the 
weighted  product  method  do  not  have  a  numerical  upper  bound. 
The  decision  maker  may  also  not  find  any  true  meaning  in  those 
scores.  Hence,  it  may  be  convenient  to  compare  each  alternative 
score  with  the  standard  score.  If  an  alternative  is  compared  to  the 
ideal  alternative  for  the  only  comparison  purpose,  the  ratio  is  given 
by 


n"=1  *ijWj 

UU  (*PWj  ’ 


i=l,2, 


m 


(20) 


where  x*.  is  the  most  favorable  performance  for  criteria  j.  It  is  found 
clearly  that  the  preference  of  alternative  i  increases  when 
approaches  to  1. 


negative  solution.  The  method  assumes  that  each  criteria  has  a 
monotonically  increasing  or  decreasing  utility.  This  makes  it  easy 
to  locate  the  ideal  and  negative  ideal  solutions. 

The  positive  distance  between  alternative  A,  and  the  ideal 
solution  A+  is  defined  as  follows: 


sT  = 


\ 


n 


»n-*T)2 


j= 1 


(21) 


where  xt  is  the  jth  criteria’s  performance  of  the  ideal  solution  A+. 
The  negative  distance  is  similarly  calculated  as  follows: 


si  =\  Z^(xo  -xr)2  (22) 

\ 

where  xj  is  the  j-th  criteria’s  performances  of  the  negative  ideal 
solution  A~. 

Finally,  the  relative  closeness  degree  of  A,  and  A+  is  defined  to: 


ST 


st  +  s; 


+ 


(23) 


The  best  alternative  is  one  that  has  the  maximum  closeness 
degree  and  has  the  shortest  distance  to  the  ideal  solution. 


4.2.3.  Grey  relation  method 

Grey  relational  method  is  a  branch  of  grey  systems  theory 
developed  in  1980  [129]  and  has  been  largely  applied  to  MCDA 
problems  in  addition  to  energy  systems  [45,60,76,87].  The 
principle  of  grey  relation  method  is  similar  to  TOPSIS.  The  grey 
relation  degree  is  defined  in  the  method  to  show  the  closeness 
between  the  alternatives.  Usually,  the  ideal  solution  is  defined  and 
the  alternatives’  relation  degree  with  it  are  calculated.  The  grey 
relational  coefficient  of  the  jth  criteria  between  alternative  A/  and 
the  ideal  solution  A*  can  be  calculated  as: 


4.2.  Unique  synthesizing  criteria  methods 

4.2.1.  AHP 

AHP  is  widely  used  for  practical  MCDA  method  in  various 
domains,  such  as  social,  economic,  agricultural,  industrial, 
ecological  and  biological  systems,  in  addition  to  energy  systems 
[30,33,41-43,49,50,52,57,74,79-81].  It  is  a  descriptive  decision 
analysis  methodology  that  calculates  ratio-scaled  importance  of 
alternatives  through  pair-wise  comparison  of  evaluation  criteria 
and  alternative.  It  involves  decomposing  a  complex  decision  into  a 
hierarchy  with  goal  (objective)  at  the  top  of  the  hierarchy,  criteria 
and  sub-criteria  at  levels  and  sub-levels  of  the  hierarchy,  and 
decision  alternatives  at  the  bottom  of  the  hierarchy. 

AHP  is  a  type  of  weighted  sum  method.  The  weights  obtained  in 
AHP  method  are  introduced  in  Section  3.1.  After  obtaining  the 
weights,  each  performance  at  the  given  level  is  then  multiplied 
with  its  weight  and  then  the  weighted  performances  are  summed 
to  get  the  score  at  a  higher  level.  The  procedure  is  repeated  upward 
for  each  hierarchy,  until  the  top  of  the  hierarchy  is  reached.  The 
overall  weights  with  respect  to  goal  for  each  decision  alternative  is 
then  obtained.  The  alternative  with  the  highest  score  is  the  best 
alternative. 

4.2.2.  TOPSIS 

TOPSIS  is  used  as  a  weighting  method  in  Section  3.  Likewise,  it 
can  also  be  seen  as  a  MCDA  method.  TOPSIS  [126]  is  based  on  the 
concept  that  the  ideal  alternative  has  the  best  level  for  all  criteria, 
whereas  the  negative  ideal  is  the  one  with  all  the  worst  criteria 
values  [29].  The  principle  is  simple:  the  selected  best  alternative 
should  have  the  shortest  distance  from  the  positive  ideal  solution 
in  geometrical  sense  while  it  has  the  longest  distance  from  the 


min, min, lx*  -  x,-,j  +  £max,max,lx^  -  x,-,j 

a(A),Au)  = - - T—1 - — -  (24) 

J  J  |x*. -x,j| +^maxJmax,  |x*. -x,j| 

where  x*-  is  the  most  favorable  performance  for  criteria  j,  £  is  the 
distinguishing  coefficient,  0  <  £  <  1,  min,  min,-  |x*.  -  x, j |  is  second¬ 
ary  smallest  error  of  A,  and  A*,  and  maxj  max,  |x*.  -  x,j|  is  secondary 
biggest  error. 

Then  the  grey  relational  degree  is  equal  to  the  weighted  sum  of 
its  grey  relational  coefficients.  The  alternative  with  the  maximum 
relation  degree  has  shortest  distance  from  the  ideal  solution  while 
it  has  the  longest  distance  from  the  worst  solution.  Thus  the  best 
alternative  is  selected  according  to  the  grey  relation  degree. 

4.2.4.  MCDA  combined  fuzzy  methodology 

The  classic  MCAD  methods  generally  assume  that  all  criteria 
and  their  respective  weights  are  expressed  in  crisp  values  and, 
thus,  that  the  rating  and  the  ranking  of  the  alternatives  can  be 
carried  out  without  any  problem.  In  a  real-world  decision 
situation,  the  application  of  the  classic  multi-criteria  evaluation 
methods  may  face  serious  practical  constraints  from  the  criteria 
perhaps  containing  imprecision  or  vagueness  inherent  in  the 
information.  Due  to  the  availability  and  uncertainty  of  information 
as  well  as  the  vagueness  of  human  feeling  and  recognition,  like 
“equally”,  “moderately”,  “strongly”,  “very  strongly”,  “extremely” 
and  a  “significant  degree”,  it  is  relatively  difficult  to  provide  exact 
numerical  values  for  the  criteria,  make  an  exact  evaluation  and 
convey  the  feeling  and  recognition  of  objects  for  decision  makers. 
Hence  most  of  the  selection  parameters  cannot  be  given  precisely 
and  the  evaluation  data  of  the  alternative  suppliers’  suitability  for 
various  subjective  criteria  and  the  weights  of  the  criteria  are 
usually  expressed  in  linguistic  terms  by  the  decision  makers. 
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Furthermore,  it  is  also  recognized  that  human  judgment  on 
qualitative  criteria  is  always  subjective  and  thus  imprecise. 

Fuzzy  set  theory  introduced  by  Zadeh  in  1965  [130]  can  just 
solve  the  problem  and  it  play  a  significant  role  in  this  kind  of 
decision  situation.  The  combination  of  MCDA  methods  and  fuzzy 
set  theory  [131]  has  been  applied  in  many  systems  in  addition  to 
energy  systems  [13,26,29,39,40,55,60,72,84,127]. 

4.3.  The  outranking  methods 

The  foundation  of  the  outranking  methods  is  the  construction 
and  the  exploitation  of  an  outranking  relation  that  is  introduced  by 
Roy.  An  outranking  relation  is  a  binary  relation  S  defined  on  the  set 
of  alternatives  A  such  that  for  any  pair  of  alternatives  (Ai:Ak)  e  A  x 
A  :  A{SAk  if,  given  what  is  known  about  the  preferences  of  the 
decision  maker,  the  quality  of  the  evaluations  of  the  alternatives 
and  the  nature  of  the  problem  under  consideration,  there  are 
sufficient  arguments  to  state  that  the  alternative  A,  is  at  least  as 
good  as  the  alternative  Ak,  while  at  the  same  time  no  strong  reason 
exists  to  refuse  this  statement. 

Compared  to  the  other  multi-criteria  evaluation  methods,  the 
outranking  methods  have  the  characteristic  of  allowing  incompar¬ 
ability  between  alternatives.  This  characteristic  is  important  in 
situations  where  some  alternatives  cannot  be  compared  for  one  or 
another  reason. 


4.3 A.  Elimination  et  choice  translating  reality  (ELECTRE)  method 

Elimination  et  choice  translating  reality  (ELECTRE)  method  was 
proposed  by  Benayoun,  Roy  and  Sussman  in  1966  and  it  was 
developed  and  improved  by  Roy  in  1971  [132-135].  Up  to  now, 
ELECTRE  families  have  included  ELECTRE  I,  II,  III,  IV,  TRI  and  some 
improved  ELECTRE  methods.  For  most  ELECTRE  methods,  there  are 
two  main  stages.  These  are  the  construction  of  the  outranking 
relations  and  the  exploitation  of  these  relations  to  get  the  final 
ranking  of  the  alternative.  Different  ELECTRE  methods  may  be 
different  in  how  they  define  the  outranking  relations  between 
alternatives  and  how  they  apply  these  relations  to  get  the  final 
ranking  of  the  alternatives. 

ELECTRE  concentrates  the  analysis  on  the  dominance  relations 
among  the  alternatives.  The  basic  concept  of  ELECTRE  is  how  to  deal 
with  outranking  relation  by  using  pair-wise  comparisons  among 
alternatives  under  each  criteria  separately.  It  is  based  on  the  study  of 
outranking  relations,  exploitation  notions  of  concordance.  These 
outranking  relations  are  built  in  such  a  way  that  it  is  possible  to 
compare  alternatives.  It  uses  concordance,  discordance  indexes  and 
threshold  values  to  analyze  the  outranking  relations  among  the 
alternatives.  The  concordance  index  for  a  pair  of  alternatives  A;  and 
Ak  measures  the  strength  of  the  hypothesis  that  alternative  A,  is  at 
least  as  good  as  alternative  Ak.  There  are  no  unique  measures  of 
concordance.  In  ELECTRE  II,  the  concordance  index  C(A,A/<)  for  each 
pair  of  alternatives  (A,A/<)  is  defined  as  follows: 


C(A,-A) 


Ej6Q(AAJW-/' 


£7= 


j= i  wj 


(25) 


where  Q(A,  A/<)  is  the  set  of  criteria  for  which  A,  is  equal  of  preferred 
to  (i.e.,  at  least  as  good  as)  Ak,  and  Wj  is  the  weight  of  the  jth  criteria. 
The  discordance  index  D(Azv4/<)  is  defined  as  follows: 


D(Aub) 


maxjeQ'(A,b) 

xbj  xA,j 

max^-, 

j  XA j 

(26) 


After  computing  the  concordance  and  discordance  indices  for 
each  pair  of  alternatives,  the  graphs  for  strong  and  weak 
relationship  can  be  painted  respectively  by  comparing  these 
indices  with  the  threshold  values.  Then  these  graphs  are  employed 
to  obtain  two  complete  preorders  based  on  descending  and 
ascending  distillation  chains.  Finally,  the  comparison  of  the  two 
complete  preorders  is  used  to  elaborate  the  final  ranking  order  of 
alternatives. 

ELECTRE  methods  are  sometimes  unable  to  identify  the 
preferred  alternative,  and  in  this  case,  they  produce  a  core  of 
leading  alternatives.  Such  methods  have  been  widely  used  in 
energy  DM  [32,46,47,65,66,75,82,88,90].  ELECTRE  methods  are 
particularly  convenient  when  encountering  a  few  criteria  with  a 
large  number  of  alternatives  in  a  DM  problem. 


4.3.2.  Preference  ranking  organization  method  for  enrichment 
evaluation  (PROMETHEE) 

PROMETHEE  method  developed  by  Brans  [136]  has  been  used 
in  energy  planning  and  applications,  such  as  geothermal  energy 
project  [83,89]  renewable  energy  [86,90]  energy  exploitation  [55]. 
This  method  uses  the  outranking  principle  to  rank  the  alternatives, 
combined  with  the  ease  of  use  and  decreased  complexity.  It  is  well 
adapted  to  problems  where  a  finite  number  of  alternatives  are  to 
be  ranked  considering  several,  sometimes-conflicting  criteria.  The 
principle  is  the  construction  and  the  exploitation  of  a  valued 
outranking  relation  tt.  Two  complete  preorders  can  be  obtained  by 
ranking  the  alternatives  according  to  their  incoming  flow  and  their 
outgoing  flow.  The  intersection  of  these  two  preorders  yields  the 
partial  preorder  of  PROMETHEE  I  where  incomparabilities  are 
allowed.  The  ranking  of  the  alternatives  according  to  their  net  flow 
yields  the  complete  preorder  of  PROMETHEE  II. 

Like  to  ELECTRE  method,  it  also  performs  a  pair-wise 
comparison  of  alternatives  in  order  to  rank  them  with  respect 
to  a  number  of  criteria.  However,  ELECTRE  method  only  pay 
attention  to  the  preference  and  ignore  the  difference  level  between 
alternatives  when  determining  the  ranking  order.  PROMETHEE 
introduces  the  preference  functions  to  measure  the  difference 
between  two  alternatives  for  any  criteria.  Brans  have  offered  six 
generalized  criteria  functions  including  usual  criteria,  quasi 
criteria,  criteria  with  linear  preference,  level  criteria,  criteria  with 
linear  preference  and  indifference,  and  Gaussian  criteria. 

Multi-criteria  preference  index  for  a  pair  of  alternatives  A/  and 
Ak  is  defined  as 


n(Ai,Ak) 


£"=i  WjP,(A-A) 


jrj' 


£  U  wj 


(27) 


where  pfa,b )  is  the  preference  functions  for  alternatives  a  and  b. 
Then  the  incoming  flow  is  calculated  as: 


m 

<P+(At .)  =  5>(AA),  fc=  (28) 

k= 1 

and  the  outgoing  flow  is  calculated  as 


m 

<MA)  =  I>(AoA),  fe=  (29) 

k= 1 

Finally,  the  net  flow  is  equal  to  the  difference  of  incoming  flow 
and  outgoing  flow.  After  obtaining  all  net  flows  of  alternatives,  the 
alternative  having  maximum  net  flow  is  considered  as  the  best. 


where  xaj  and  xbj  represent  the  performances  of  alternative  A,  and 
Ak  in  terms  of  criteria  j  respectively,  (X(AitAk)  is  the  set  of  criteria  for 
which  A/  is  worse  than  Ak,  and  n  is  the  number  of  criteria.  The 
formula  can  be  only  used  when  the  scores  for  different  criteria  are 
comparable. 


5.  Aggregation  methods 

Usually,  the  decision  maker  selects  the  best  alternative  based 
on  the  ranking  orders  after  the  calculation  in  a  selected  MCDA 
method.  However,  the  creditability  of  DM  is  necessarily  verified  so 
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that  the  results  of  the  ranking  orders  are  computed  by  a  few  MCDA 
methods  sometimes.  The  application  of  various  MCDA  methods  of 
calculation  may  yield  different  results  (preference  ranking  order). 
The  question  “Which  method  is  most  suitable  to  solve  the 
problem?”  is  most  important,  but  difficult  to  answer.  Therefore, 
the  ranking  results  are  necessarily  aggregated  again  and  the  best 
scheme  from  the  alternatives  is  selected  as  displayed  in  Fig.  2.  The 
methods  used  to  aggregate  the  preference  orders  are  called  as 
aggregation  methods  in  this  article.  In  the  reviewed  papers,  there 
are  few  consideration  on  about  aggregation  methods  in  energy  DM 
while  the  aggregation  methods  were  applied  in  social  and 
economic  systems  [107].  The  aggregation  methods  can  be  divided 
into  two  categories:  voting  method  and  mathematical  aggregation 
method.  The  mathematical  aggregation  methods  are  classified  to 
two  sub-categories,  “hard  aggregation  method”  and  “soft  aggrega¬ 
tion  method”  based  on  with  or  without  the  decision-makers. 

5.2.  Voting  methods 

A  very  general  approach  to  aggregating  alternatives’  prefer¬ 
ences  is  the  voting  methods.  The  winning  alternative  in  voting 
methods  depends  on  which  voting  rule  is  used.  Generally,  Borda 
rule  and  Copeland  rule  [137]  are  the  most  common  voting  rules. 

5.2.2.  Borda 

Borda  rule  is  to  select  the  option  that  on  average  stands  highest 
in  the  voters’  rankings.  Firstly,  assign  points  to  the  m  alternatives  in 
the  individual  preferences,  namely  m  -  1  points  for  the  top  ranked 
alternative,  m-2  points  for  the  second  ranked  alternative,  down 
to  0  points  for  the  bottom  ranked  alternative;  then  add  up  those 
points  over  all  individuals  for  every  alternative;  Finally  the  more 
points  an  alternative  receives  the  higher  ranked  it  is  in  the  social 
preference. 

5.2.2.  Copeland 

Copeland  rule  is  to  select  the  option  (if  one  exists)  that  beats 
each  other  option  in  exhaustive  pair-wise  comparison.  Firstly, 
calculate  the  number  of  alternatives  it  beats  by  a  majority  and  the 
number  of  alternatives  it  looses  against  for  each  alternative;  then 
calculate  the  difference  between  the  two  numbers;  finally,  the 
larger  the  number  the  higher  ranked  is  the  alternative  in  the  social 
preference. 

5.2.  Mathematical  aggregation  methods 

5.2 A.  Hard  aggregation  methods 

“Hard  aggregation  methods”  mean  that  the  aggregating  results 
cannot  require  the  decision-maker  and  are  obtained  in  mathe¬ 
matical  methods  over  the  ranking  orders  of  alternatives,  which 
avoid  the  preference  of  decision-makers.  The  aggregating  results 
have  strong  objectivity  and  the  selected  scheme  is  compelling.  The 
basic  aggregation  method  is  the  average  method  and  the 
developed  aggregation  methods  include  vertical  and  horizontal 
aggregation  method,  and  singular  value  decomposition  aggrega¬ 
tion  method.  The  principle  of  vertical  and  horizontal  aggregation 
method  is  similar  to  the  method  in  Section  3.2.3  and  it  is  also  an 
optimal  method  based  on  the  ranking  orders  or  the  evaluation 
scores  of  alternatives.  The  singular  value  decomposition  aggrega¬ 
tion  method  has  been  employed  to  analyze  the  feasibility  of 
combination  weighting  method  for  criteria  of  CHP  [87]  and  the 
principle  applied  to  aggregation  of  ranking  orders  is  same. 

5.2.2.  Soft  aggregation  methods 

“Soft  aggregation  methods”  require  the  decision-maker  and  the 
final  results  are  obtained  through  the  negotiation  of  decision¬ 
makers  when  there  are  difference  or  collision  of  opinion.  The 


method  embodies  the  flexible  decision  that  makes  the  majority  of 
decision-makers  satisfied.  The  “soft  aggregation  methods”  are 
more  seldom  in  practical  application.  Yi  et  al.  proposed  the 
aggregation  methods  treating  the  multi-evaluation  conclusions 
characterized  by  disagreement  [138]  and  conflict  [139]. 

6.  Conclusion 

A  review  of  the  published  literature  on  sustainable  energy 
decision-making  presented  here  indicates  greater  applicability  of 
MCDA  methods  in  changed  socio-economic  scenario  and  leads  to 
the  following  conclusions: 

(1 )  Multi-attributes  considered  in  the  sustainable  energy  decision¬ 
making  gains  increasing  popularity.  It  can  be  observed  that 
efficiency,  investment  cost,  C02  emission  and  job  creation  are 
the  most  common  criteria  in  the  technical,  economic, 
environmental  and  social  attributes  respectively.  The  invest¬ 
ment  cost  locates  the  first  place  in  all  evaluation  criteria  and 
C02  emission  follows  closely  because  of  more  focuses  on 
environment  protection. 

(2)  Criteria  weights  influence  directly  the  decision-making  results  of 
energy  projects’  alternatives.  Equal  criteria  weights  are  still  the 
most  popular  in  weighting  methods.  AHP  method  in  the  rank- 
order  weighting  method  is  more  and  more  prevalent  because  of 
its  understandability  in  theory  and  the  simplicity  in  application. 
The  objective  and  combination  weighting  methods  rise  in  the 
decision-making  gradually.  They  will  be  largely  applied  to 
sustainable  energy  decision-making  because  they  evaluate  the 
relative  importance  objectively  without  decision-makers. 

(3)  MCDA  methods  have  been  widely  employed  to  sustainable 
energy  decision-making  considering  multi-criteria.  It  is 
observed  that  AHP  is  the  most  popular  comprehensive  method 
so  that  the  elementary  weighted  sum  method  is  still  basic  in 
multi-criteria  decision-making  problems.  Fuzzy  set  methodol¬ 
ogy  has  been  increasingly  applied  to  take  care  of  the  qualitative 
criteria  and  the  imprecision  or  vagueness  inherent  in  the 
information. 

(4)  The  evaluation  and  calculation  in  the  sustainable  energy 
decision-making  is  usually  obtained  in  a  MCDA  method.  It  is 
necessary  that  a  few  different  styles  of  MCDA  methods  are 
applied  to  get  the  ranking  orders  of  energy  projects’  alternatives 
and  the  validity  in  MCDA  methods  is  verified.  It  is  believed  that 
the  results  obtained  by  the  aggregation  methods  are  more 
rational  and  more  aggregation  methods  will  aid  in  the 
sustainable  energy  decision-making  in  the  future. 

As  long  as  criteria  selection  and  weights,  MCDA  methods  and 
aggregation  methods  are  appropriate  and  suitable  to  the  specific 
decision  problems,  MCDA  can  become  a  powerful  tool  for  the 
decision-making  of  sustainable  energy  systems. 
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